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METHOD OF SPEECH SYNTHESIS BY MEANS OF CONCATENATION AND 
PARTIAL OVERLAPPING OF WAVEFORMS 

Abstract 

5 

Method for speech signal synthesis by means of time concatenation of 
waveforms representing elementary units of speech signal, in which: at 
least the waveforms associated to voiced sounds are subdivided into a 
plurality of intervals, corresponding to the responses of the vocal duct 

1 0 to a series of excitation impulses of the vocal cords, synchronous with 
the fundamental frequency of the signal; each interval is subjected to a 
weighting; the signals resulting from the weighting are replaced with a 
replica ' thereof shifted in time try an amount that depends on a 
prosodic information; and the synthesis is carried out by overlapping 

1 5 and adding the shifted signals. In each interval of original signal to be 
reproduced in synthesis, an unchanging part is identified, which 
contains the fundamental information and which is reproduced 
unaltered in the synthesized signal, and the operations of weighting, 
overlapping and adding involve only the remaining part of the 

20 interval. 
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METHOD OF SPEECH SYNTHESIS BY MEANS OF CONCATENATION AND 
PARTIAL OVERLAPPING OF WAVEFORMS 

The invention described herein relates to speech synthesis and 
more particularly to a synthesis method based on the concatenation of 
D waveforms related to elementary speech units. Preferably, but not 
exclusively, the method is applied to text-to-speech synthesis. 

In these applications, a text to be transformed into a speech 
signal is first converted into a phonetic-prosodic representation, which 
indicates the sequence of corresponding phonemes and the prosodic 
5 characteristics (duration, intensity, and fundamental, period) associated 
to them. This representation is then convened into a digital synthetic 
speech signal starting from a vocabulary of said elementary units, 
which in the most common case are constituted of diphones (voice 
elements extending from the stationary part of a phoneme to the 
0 stationary part of the subsequent phoneme, the transition between 
phonemes included). For the Italian language, a vocabulary of about 
one thousand diphones ensures the phonetic coverage, allowing all 
admissible sounds for Italian language to be synthesized. 

In systems for text-to-speech synthesis, methods based on the 
5 concatenation, in the time domain,' of the waveforms representing the 
various elementary units can be used for the generation of the speech 
signal: these methods are very flexible and guarantee good synthetic 
speech quality. . 
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An example is described by E. Moulines and F. Charpcntier in the 
paper "Pitch-synchronous waveform processing techniques for text-to- 
speech synthesis using diphones", Speech Communication, Vol. 9, No. 
5/6, December 1990, pages 453-467. This method is based on the 
5 technique known as PSOLA (Pitch-Synchronous OverLap and Add), to 
apply the prosody imposed by the synthesis rules and concatenate the 
waveforms of the elementary units. At least for the voiced segments of 
the original signal, the PSOLA technique carries out an analysis by 
applying a pitch-synchronous windowing, in particular by using 

1 0 Hanning windows whose duration is roughly twice the fundamental 
period (pitch period), thereby generating a sequence of partially 
overlapping short-term signals; in the synthesis . phase, the signals 
resulting from the windowing are shifted in time synchronously with 
the fundamental period imposed by the prosodic rules for synthesis; 

1 5 finally, the synthetic signal is generated by overlapping and adding the 
shifted signals. To reduce computational complexity, the second step 
can be carried out directly in the time domain. 

The complete windowing of. the individual intervals of the 
original signal requires a relatively heavy computational load and 

2 0 moreover it constitutes an alteration of the original signal extending 
over the entire interval, so that the synthetic signal sounds less natural. 

According to the invention, a synthesis method is provided in 
which that part of each interval of the original signal which contains 
the fundamental information is left unchanged, and only the 

2 5 remaining part of the interval is altered: this way, not only processing 

time is reduced, but the natural sounding of the synthetic signal is also 
improved, since the main part of the interval is the exact reproduction 
of the original signal. 

The invention therefore provides a method for the speech signal 

3 0 synthesis by means of time-concatenation of waveforms representing 

elementary speech signal units, in which: at least the waveforms 
associated to ,voiced sounds are divided into a plurality of intervals, 
corresponding to the responses of the vocal duct to a series of impulses 
exciting the vocal cords synchronously with the fundamental frequency 
3 5 of the signal; the waveform in each interval is weighted; the signals 
resulting from the weighting are replaced with a replica thereof, shifted 
in time by an amount depending on a prosodic information; and the 
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synthesis is carried out by overlapping and adding the shifted signals; 
and in which: . 

a current interval of original signal to be reproduced in synthesis 
is subdivided into an unchanging part, which lies between the- interval 
5 beginning and a left analysis edge represented by a zero crossing of the 
original speech signal that meets pre-determined conditions, and a 
changeable part, which lies between the left analysis edge and a right 
analysis edge essentially coinciding with the end of the current interval, 
the left and right analysis edges being associated, in the synthesized 
1 0 signal, respectively with a left and a right synthesis edge, of which the 
former coincides with the left analysis edge, with reference to a start-of- 
interval marker, and the latter coincides essentially with the end of the 
interval in the synthesized signal; 

a first connecting function, which has a duration equal to that of. 
1 5 the segment of synthesized waveform lying between the left and right 
synthesis edges and an amplitude which decreases progressively and is 
maximum in correspondence with the left analysis edge, is applied on 
the part of waveform on the right of the left analysis edge of the current 
interval of original signal; 
20 - a second connecting function, which has a duration equal to that 
of the segment of synthesized waveform lying between the left and right 
synthesis edges and an amplitude which increases progressively and is 
maximum in correspondence with the beginning of said subsequent 
interval, is applied on the part of waveform on the left of the 
25. subsequent interval of original signal to be reproduced synthetically; 

each interval of synthesized signal is built by reproducing 
unchanged the waveform in the unchanging part of the original 
intervaland by joining thereto the waveform obtained by aligning in 
time and adding the two waveforms resulting from the application of 
3 0 the first and second connecting functions. 

For the sake of further clarification, reference is made to the 
enclosed drawings, which illustrate an embodiment of the invention 
given by way of non-limiting example and where: 

Figure 1 is the general outline of the operations of a text-to-speech 
3 5 synthesis system through concatenation of elementary acoustic unit; 

Figure 2 is a diagram of the synthesis method through 
concatenation of diphones and modification of the prosodic parameters 
in the time domain, according to the invention: 
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Figure 3 represents the waveform of a real diphone, with the 
markers for the phonetic and diphone borders and the pitch markers; 

Figures 4, 5 and 6 are graphs representing how the prosodic 
parameters of a natural speech signal are modified in some particular 
5 cases, according to the invention; 

Figures 7A, 7B, 8A, 8B, 9A, 9B, 10A and 10B are some real examples 
of application of the method according to the invention for the 
modification of the fundamental period on segments of the diphone in 
Figure 3; 

10 - Figures 11 - 18 are' flow charts of the operations for determining 
the left analysis and synthesis edge. 

Before describing the invention in detail, the structure of a text-to- 
speech synthesis system is briefly described. 

As can be seen in Figure 1, as a first phase the written text is fed to . 

15 a linguistic processing stage TL which transforms the written text into a 
pronounceable form and adds linguistic markings: transcription of 
abbreviations, numbers, application of stress and grammatical 

classification rules, access to lexical information contained in a special 
vocabulary' VL. The subsequent stage, TF, carries out the transcription 

20 from orthographic sequence to the corresponding string of phonetic 
symbols. On the basis of a set of prosodic rules RP, the prosodic 
processing stage TP provides duration and fundamental period (and 
thus also fundamental frequency) for each of the phonemes leaving TF. 
This information is then provided to the pre-synthesis stage PS, which 

25 determines for each phoneme, the sequence of acoustic signals forming 
the phoneme (access to diphone data base VD) and, for each segment, 
how many and which intervals, with duration equal • to the 
fundamental period, are to be used (in the case of voiced sounds) and 
the corresponding values of the fundamental period to be attributed in 

3 0 synthesis. These values are obtained by interpolating the values 
assigned in correspondence with the phoneme borders. In the case of 
unvoiced or "surd" sounds, in which there are no periodicity 
characteristics, the intervals have a fixed duration. This information is 
finally used by the actual synthesizer SINT which performs the 

3 5 transformations required to generate the synthetic signal. 

Figure 2 illustrates in greater detail the operation of modules PS 
and SINT. The input is constituted by the current phoneme identifier F\, 
by the phoneme duration Dj and by the values of the fundamental 
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period Pj. j at the beginning of the phoneme and Pi at the end of the 
phoneme, and by the identifiers of the previous phoneme Fj.i and of 
the subsequent one Fj + i. The first operation to be performed is to 
decode diphones DF^i and DF^ and to detect the markers of diphone 
5 beginning and end and of phoneme border. This information is drawn 
directly from the data base or vocabulary storing diphones as 
waveforms and the related border, voiced/unvoiced decision and pitch 
marking descriptors. The subsequent module transforms said 
descriptors taking the phoneme as a reference. On the basis of this 

1 0 information, a rhythmic module computes the ratio between duration 
D i imposed by the rule and the intrinsic duration of the phoneme 
(memorized in the vocabulary and given by the sum of the two 
portions of the phoneme belonging to the two diphones DFj_2 DFj). 
Then, taking into account the modification of the duration, it 

1 5 computes the number of intervals to be used in synthesis and 
determines the value of the fundamental period for each of them, by 
means of a law of interpolation between value Pj-i and Pj. The value of 
the fundamental period is then actually used only for voiced sounds, 
while for unvoiced sounds, as stated above, intervals are considered to 

20 be of fixed duration. 

For the actual synthesis, the operations are different depending 
on whether the sound is voiced or unvoiced. 

In the case of unvoiced sound, the synthesis demands a simple 
time shift (lengthening or shortening) of the aforesaid intervals on the 

2 5 basis of the ratio between the duration imposed by the prosodic rules 

and the intrinsic duration. In the case of voiced sound, instead, the 
method according to the invention is applied. 

The synthesis method according to the invention starts from the 
consideration that a voiced sound can be considered as a sequence of 

3 0 quasi-periodic intervals, each defined by. a value p a of the fundamental 

period. This is clearly seen in Figure 3, which shows the waveform of 
diphone "i.m", the related markers separating individual intervals 
and, for each interval, value p a of the corresponding period expressed 
in Hz. The part of Figure 3 between the two markers "v" . corresponds to 
3 5 the right portion of phoneme "k"; the part between the second marker 
"v M and the end-of-diphone marker "f corresponds to the left part of 
phoneme n m". The aforesaid intervals may be considered as the 
impulse responses of a filter, stationary for some milliseconds and 
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corresponding to the vocal duct, which is excited by a sequence of 
impulses synchronous with the fundamental frequency of the source 
(vibrating frequency of the vocal cords). For each interval the synthesis 
module is to receive the original signal with fundamental period p a 
5 (analysis period) and to provide a signal modified with period p s 
(synthesis period) required by prosodic rules. 

The essential information characterizing each speech in nerval is 
• contained in the signal part immediately following the excitation 
impulse (main part of the response), while the response itself becomes 
1 0 less and less significant as . the distance from the impulse position 
increases. Taking this into account, in the synthesis method according 
to the invention this main .,part is maintained as unchanged as possible 
and the lengthening or shortening of the period required by the 
prosodic rules are obtained by acting on the remaining part. 

1 5 For this purpose, an unchanging and a changeable pan are then 

identified in each interval, and only the latter is involved , in 
connection, overlap and add operations. The unchanging part of the 
original signal is not constant, but rather it depends for each interval 
on the ratio between p s and p a . This unchanging part lies between the 

2 0 start-of-interval marker and a so-called left analysis edge b sa , which is 

one of the zero crossings of the original speech signal, identified with 
criteria that will be described further on and that can be different 
depending on whether the synthesis period is longer, shorter or equal to 
the analysis period. The changeable part is delimited by the left 
25 analysis edge b sa and by a so-called right analysis edge b<i a , which 
essentially coincides with the end of the interval, in particular with the 
sample preceding the start-of-interval marker of the subsequent 
interval. 

In the synthesized signal,- a left and a right synthesis edge b ss , 

3 0 will correspond to the left and right analysis edge b sa , ba a . For a given 

interval, the left synthesis edge obviously coincide with the left analysis 
edge, with reference to the start-of-interval marker, since the preceding 
part of signal is reproduced unaltered in the synthesis. The right 
synthesis edge is defined by relation 
3 5 b ds = b ss +Ap (l) 

where Ap = p s - p a will have a positive or negative value depending on 
whether, in synthesis, there is a lengthening or shortening of the 
fundamental period. 
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The changeable part of the interval is modified by applying a pair 
of connecting functions whose duration is As - b^s " t>ss- The fi rs * 
function has a maximum value (specifically 1) in correspondence with 
the left analysis edge and a minimum value (specifically 0) in 
5 correspondence with the point b sa + As. The second function has a 
maximum value (specifically 1) in correspondence with the right 
analysis edge b^a an ^ a minimum value (specifically 0) in 
correspondence with point b<i a - As. The connecting functions can be of 
the kind commonly used for these purposes (e.g. Hanning windows or 

1 0 similar functions). 

For the sake of further clarifying the invention, Figures 4-6 show 
some graphs illustrating the application of the method to a fictitious 
signal. In these Figures, part A shows three consecutive intervals of the 
original signal, with indexes i-1, i, i+1, and indicates also their 

1 5 fundamental periods p a h (h - i-1, i, i+1) as well as pitch (or start-of- 
interval) markers Ma and the left and right analysis edges b sa , b^ a . 
Parts B and C show, for each interval, respectively the first and second 
connecting functions (which hereinafter shall be called for the sake of 
simplicity "function B" and "function C") and the time relations with 

20 the original signal. Part D shows the synthesized signal waveforms 
resulting from the method according to the invention, with the 
indication of the respective fundamental periods p s ^ (k = j-1, j, j+1), of 
pitch markers Ms and of left and right synthesis edges b ss , b^ s . Part E is 
a representation of the waveform portion where, after the time shift, the 

25. waveforms obtained with the application of the two' connecting 
functions to the changeable part of the original signal are submitted to 
the overlapping and adding process. Note that the serial numbers of the 
intervals in analysis and synthesis can be different, since suppressions 
or diplications of intervals may have occurred previously. 

3 0 In particular, Figure 4 illustrates the case of an increase in 

fundamental period (and therefore decrease in frequency) in synthesis 
with respect to the original signal, in a signal portion where no interval 
suppressions or duplications have occurred. Weighting is carried out in 
each interval with a respective pair of connecting functions. As a 

3 5 consequence of the period increase, duration As of the functions is 
greater than the length of the variahle pan of the original signal, so 
that function B also interests the beginning of the waveform related to 
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the subsequent interval, while function C interests a part of waveform 
on the left of the left analysis edge. 

Figure 5 shows an analogous representation in the case of decrease 
in fundamental period (and therefore increase in frequency) in 
5 synthesis with respect to the original signal. In this example too no 
interval suppressions or duplications occurred. In this case functions B, 
C interest a waveform portion with shorter duration than the portion 
lying between b sa and b^a- 

Finally, Figure 6 shows an example of increase in fundamental 

1 0 period in synthesis in the case of suppression of an interval of the 
original signal (the one with index i in the example). Two intervals axe 
obtained in synthesis, indicated by indexes j-1 and j, which intervals 
respectively maintain, as unchanging part, the one of intervals with 
index i-1 and i+1 in the original signal. The interval with index i+1 in 

15 the original signal is processed in the same way as each interval of 
original signal in Figure 4. The modified part of the interval with index 
j-1 in the synthesized signal, instead, is obtained by overlapping and 
adding the two waveforms obtained by weighting only with function B 
the changeable part of the interval with index i-1 in the original signal, 

20 and by weighting only with function C the final part of the interval 
with index i in the original signal. In other words, function B is applied 
on the right of b sa in the current interval to be reproduced in synthesis, 
and function C is applied on the left of the subsequent interval to be 
reproduced. These procedures of application of the connecting 

2 5 functions are quite general and are applied also in case of interval 

duplication and diphone change. 

Purely by way of example, for the diagrams in figures 4 - 6 the 
following functions were utilized: 

0,5 - 0,5-cos{rc[(As-l+b ss -Xi)/(As-l)] n } (function B) 

3 0 0,5 - 0 f 5-cos{u[(xi-b ss )/(As-l)] B } (function C) 

In these functions, b ss , As have the meaning seen previously and 
are expressed as a number of samples; Xj is the generic sample of the 
variable pan of the original waveform (with b sa < xj < b sa + As, for 
function B t and bd a - As £ xj < bfa for function C); n is a number which 
3 5 can vary (e.g. from 1 to 3) depending on ratio As/p a : in particular, in 
the drawing, n was .considered to be 1. Obviously, in the formulas, value 
0.5 can be replaced by a generic value A/2 if a function whose 
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maximum is A instead of 1 is used, or by a pair of values whose sum is 
1 (or A). 

Figures 7 A, 7B to 10 A, 10B represent some real examples of 
application of the method, for two portions of diphbne "ijni" of Figure 
5 3, utilized in two different positions in the sentence where the synthesis 
rules require respectively a decrease and an increase in fundamental 
period (and therefore an increase and respectively a decrease in 
fundamental frequency). For all intervals, pitch markers, left analysis 
and synthesis edges and fundamental frequency, both in analysis and 

1 0 synthesis, are indicated. Figures with letter A show the original 
waveform and Figures with letter B the synthesized signal. Figures 7 A, 
7B, 8A, 8B show the first two intervals of the diphone being examined 
(phoneme "a") in case of increase (Figures 7A, 7B) and respectively of 
decrease (Figures 8A, 8B) of the fundamental frequency. Figures 9A, 9B, 

15 10A, 10B show instead the first two intervals of phoneme "m" in the 
same conditions as illustrated in Figures 7, 8. As an effect of the 
frequency decrease, only the first interval is completely visible in Figures 
8B and 10B. 

A preferred embodiment ' of the method adopted to identify the 
2 0 left analysis and synthesis edge for each interval to be reproduced in 
synthesis will now be described. In the example described, a different 
method is used depending on whether the fundamental period in 
synthesis is smaller than or equal to the period in analysis, or it is 
greater. 

2 5, Figure 11 is the general flow chart of the operations carried out if 

Ps £ Pa* 

The first operation is the computation of . function ZCR (Zero 
Crossing Rate) indicating the number of zero crossings (step 11). In this 
computation, zero crossings that are spaced, apart from the previous 

3 0 one by less than a limited number of signal samples (e.g. 10) are 

neglected, in OTder to eliminate non-significant oscillations of the 
signal. 

As can be seen in Figure 13, the zero crossings that are considered 
are assigned an index varying from 1 to the descriptor of the total zero 
3 5 crossing number LZV (step 110). Moreover, the following variables are 
assigned (step 111): 

- bi a (right analysis edge) to the value of analysis period p a ; 

- b^s (right synthesis edge) to the value of tsynthesis period bd a '+Ap; 
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- Diff_a_s to the absolute value lApl of the difference between the 
analysis and synthesis periods. 

In these relations, as in those examined further on, the values of 
the period and the lengths of certain intervals are expressed in terms of 
5 number of samples. 

Going back to Figure 11, after computing function ZCR, a check is 
made (step 12) that the number of zero crossings found in step 11 is 
not lower than a minimal threshold of zero crossings IndZ__Min (e.g. 5 
crossings). Actually, according to the invention, it is desired to 
1 0 reproduce unaltered, in the synthesized signal, the oscillations 
immediately following the excitation impulse, which oscillations, as 
stated, are the most significant ones. If the check yields a --"positive , 
result, a possible candidate is searched among the zero crossings that 
were found (step 13) and subsequentiy a first phase of search for the left 

1 5 synthesis and analysis edges b ss , b sa is carried out (step 14). If at the 

end of step 14 .no suitable zero crossing has been found, a search 
continuation phase is started (step 15) and, if after this phase the left 
synthesis and analysis ' edges have not yet been identified, then a phase 
of continuation and conclusion of the search is started (step 17). If the 
20 comparison in step 12 indicates that the number of zero crossings is 
lower than the threshold, then the zero crossing with index J = 
IndZ_Min is arbitrarily considered as a candidate (step 18) and a 
search for b sa and b ss (step 19), identical to the one carried out in step 
14, is performed: if this search is unsuccessful, then step 17, i.e. the 

2 5 search continuation and conclusion, is directly started, without going 

through step 15, for reasons that will be clear after the latter is 
described. 

A step analogous to step 17 is envisaged also in case of 
lengthening of the fundamental period in synthesis, as will be seen 

3 0 further on. For the sake of simplicity, the same flow chart was used for 

both cases, which are distinguished by means of some conditions of 
entry into the step itself. In particular, for the case p s ^ pa the 
conditions r_P < 1 (where r_P is the ratio p s /p a )> Start = °* End = LZV » 
Step = +1 (step 16 in Figure 11) axe set The first condition is evident. 
3 5 The other . three indicate that the cycle of examination of the zero 
crossings envisaged in phase 17 will be carried out in the order of 
increasing indexes. 
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The operations performed in steps 13-15 and 17 will be described 
in detail further on, with reference to Figures 14 - 17. 

Figure 12 is the general flow chart of the operations carried out if 
the synthesis period p s is longer than the analysis period p a . The first 
5 operation (step 21) consists again in computing function 2CR and is 
identical to step 11 in Figure 1L Subsequently (step 22) a search is 
carried out for the left synthesis and analysis edges, with procedures 
that will be described with reference to Figure 18, and,- if this phase does 
not have a positive outcome, a search continuation and . conclusion 
10 phase is initiated (step 24), corresponding to step 17 in Figure 11. 
Conditions r_P > 1, Stan = LZV-1, End = -1, Step = -1 are set for the 
operations envisaged in step "*24. The first condition is evident- The 
other three indicate that the cycle of examination of the zeTo crossings 
envisaged in step 24 will be carried out in this case in the order of 
1 5 decreasing indexes. 

Figure 14 shows the flow chart of the search for a zero crossing 
which is candidate to act as left analysis and synthesis edge (step 13 in 
Figure 11). J denotes the index of the candidate. In particular, the 
central zero crossing, whose index is J = (LZV+l)/2 (step 130), is initially 

2 0 examined as a candidate and its abscissa ZCR(J) is compared with the 

right synthesis edge b& s (step 131). If this initial candidate is already 
on the left of the right synthesis edge, the phase of search for the left- 
analysis and synthesis edge (step 14, Figure 11) is started directly. In 
the opposite ca:se, zeTO crossings on the left of the central one are 
25. examined with a backwards cycle, searching for a candidate whose 
abscissa is on the left of b& s (steps 132-134). When a zero crossing that 
meets this condition is found, it is considered as a candidate (step 135) 
and the search phase (step 14 in Figure 1) is started after verifying that 
the index of the candidate is not (LZV+D/2 (step 136). In effect, a 

3 0 backward search cycle has been performed because the initial 

candidate, with index (LZY+l)/2, was on the right of b& s , and hence 
obtaining a candidate with that index signals an anomalous condition: 
if this occurs, the searcE phase is started after setting J=0. The same 
operations are performed if the cycle ends before a candidate is found. 
3 5 Figure 15 shows the operations carried out for the first phase of 

search for b ss , b sa (step 14 in Figure 11). For this search, a backward 
examination is made of the zero crossings starting from the one 
preceding LZV, and the distance Diff_z_a between the right analysis 



2150614 

12 



edge b£ a and the current zero crossing ZCR(i) is calculated (steps 140, 

141) . This distance, multiplied by r_P (ratio between the synthesis 
period p s and the analysis period p a ) is compared with Diff_a_s (step 

142) , to check that there is a time interval sufficient to apply the 
5 connecting function. Weighting with r_P links the duration of that 

function to the percentage shortening of the period and it is aimed at 
guaranteeing a good connection between subsequent intervals. If 
I>iff_a_s > Diff_z_a*rJP, the search cycle continues (step 143), until a 
zero crossing is found such that Diff_a_s £ (Diff_z_a*r_P) or until all 

1 0 zero crossings have been considered; in the latter case step 14 is left and 
step 15 (Figure 11) of search continuation, is started. When the 
condition Diff_a_s < Diff_z_a*r_P is met, the current index i is. 
compared with index J of the candidate (step 144). If i < J, the cycle is 
continued. If the two indexes are equal, then the current zeTO crossing is 

15 considered as left analysis edge b sa and as left synthesis edge b ss (step 
147); if instead i > J f then distance A„a between the right analysis edge 
bda and the current zero crossing ZCR(i), distance A_s between the right 
synthesis edge b^ s and the current zero crossing ZCR(i), and ratio A 
between A_s and A_a are calculated (step 145), and ratio A is compared 

20 to the value (r_P)/2 (step 146). If A £ (r_P)/2, then the tasks of left 
analysis edge b sa and left synthesis edge b ss are assigned to the current 
zero crossing (step 147), otherwise phase 15 (Figure 11) of search 
continuation is started. The last comparison indicates that not only a 
sufficient distance between the left and right synthesis edge is required, 

25. but also that the connecting function takes into account the shortening 
in synthesis; this, too, helps obtaining a good connection between 
adjacent intervals. 

Variable "TRUE" in the last step 147 in Figure 14 indicates that 
b sa and b ss have been found and disables subsequent search phases. 

3 0 The same variable will also be utilized with the same meajiing in the 
other flow charts related to the search for the left analysis and synthesis 
edges. 

Step 14 allows finding a candidate, if any, that lies on the left of 
the right synthesis edge and is as close as possible to it, while 
3 5 guaranteeing a time interval sufficient to apply the connecting 
function; this step is the core of the criterion of the search for b sa and 
b ss- 
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Search continuation step 15 is illustrated in detail in Figure 16. 
This step, if it is performed (negative result of phase 14 and therefore of 
the check on the TRUE condition in step 150), starts with a new 
comparison between LZV and IndZ_min (step 151), aimed now at just 
5 verifying whether LZV > IndZ_min. If the condition is not met, then 
step 17, of search continuation and conclusion is initiated. If LZV > 
IndZ_Min, then a check is made on whether the zero crossing having 
index IndZJMin is positioned on the left of the right synthesis edge s 
(step 152). In the affirmative, this crossing is considered to be the left 

10 analysis edge b sa and left synthesis edge b ss (step 153). If instead the 
zero crossing having index IndZ_Min is still on the right of the right 
synthesis edge, then step 17 (Figure 11) of search continuation and 
conclusion is initiated. 

Search continuation and conclusion step 17 is represented in 

1 5 detail in Figure 17. After checking the need to perform it (step 170), the 
zero crossings are reviewed again, in increasing index order. In the 
examination cycle (steps 171 - 174 in Figure 17), a check is made at 
each step on whether the current zero crossing (indicated by ZJTmp) is 
on the left of the right synthesis edge b& s and its distance from such 

2 0 edge is not lower than a predetermined minimum value 5, e.g. .10 signal 
samples (step 173). If the two conditions are not met, then the 
subsequent zero crossing is ' examined (step 174), otherwise this, zero 
crossing is temporarily considered as the left synthesis and analysis 
edge (step 175) and the cycle is continued. The last zero crossing that 

2 5 meets condition 173 will be considered as the left synthesis and analysis 

edge (step 179). The check on r_P at step 176 is an additional means to 
distinguish between the case p s £ p a and the case p s > p a , and it causes 
steps 177 and 178 of the flow chart to be omitted in the case being 
examined. 

3 0 Figure 18 illustrates the search for b sa and b ss when the synthesis 

period is lengthened with respect to the analysis period. This search 
starts with a comparison between the lengthening in synthesis Diff_a_s 
and half the duration of the analysis period p a (step 220). If Diff_a_s > 
.,p a /2, step 24 (illustrated in detail in Figure 17) is started directly. If 
3 5 Diff_a_s < p a /2, a backward search cycle is carried out, starting from 
the zero crossing preceding LZV. Distance Diff_z_a between the right 
analysis edge b^ a and the current zero crossing ZCR(i) (steps 221, 222) 
is calculated and is compared with Diff_a_s (step 223): if it is smaller, 
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then the search cycle continues (step 224), otherwise the current zero 
crossing is considered as the left analysis and synthesis edge (step 225). 
If, at the end of the cycle, b sa and b ss have not been determined, then 
the phase of search continuation and conclusion is initiated (phase 24, 
5 Figure 12). 

If the lengthening required in synthesis is less than or equal to 
half the analysis period, the operations described above allow finding a 
candidate, if any, that is the first for which the distance from the right 
analysis edge exceeds or is equal to the required lengthening. 

10 In the search continuation and conclusion phase, a backward 

search cycle is carried out, as stated, starting from the zero crossing 
preceding LZV, with the procedures illustrated in steps 171 - 175 in 
Figure 17. Moreover, since a lengthening of the interval is considered 
(step 176), distance A_a between the right analysis edge. b£ a and the 

1 5 current zero crossing ZJTmp, distance A_s between the right synthesis 
edge bd s and the current zero crossing ZJTmp and ratio A between 
these distances are computed (step 177) for the zero crossings that meet 
the conditions of step 173, Ratio A is compared with twice the ratio 
between the periods (r_P*2) for the same reasons seen for comparison 

2 0 146 in Figure 15, and the zero crossing that meets the condition A £ 
(rJP*2) will be taken as left analysis edge b sa and left synthesis edge b ss . 

The conditions imposed in this phase allow assigning the task of 
left analysis edge to a zero crossing that lies on the left of the right 
synthesis edge, is as close as possible to it and also guarantees a 

2 5 sufficient time interval for the connecting function be applied: in 

particular, given a certain analysis period, a left analysis edge 
positioned farther back in the original period will correspond to a 
greater lengthening required in synthesis. 

The method described herein can be performed by means of a 

3 0 conventional personal computer, workstation, or similar apparatus. 

It is evident that what is described above is given by way of non- 
limiting example and that variations and modifications are possible 
without departing from the scope of the invention. 
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WE CLAIM: 

1. Method for speech signal synthesis by means of time 

concatenation of waveforms representing elementary speech 
signal units, in which: at least the waveforms associated 
to voiced sounds are subdivided into a plurality of 
intervals, corresponding to the responses of the vocal duct 
to a series of impulses of vocal cord excitation, 
synchronous with the fundamental frequency of the signal; 
the waveform in each interval is weighted; the signals 
resulting from the weighting are replaced with a replica 
thereof shifted in time by an amount depending on a 
prosodic information; and synthesis is performed by 
overlapping and adding the shifted signals; characterized 
in that : 

- a current interval of original signal to be 
reproduced in synthesis is subdivided into an unchanging 
part, which lies between the interval beginning and a left 
analysis edge represented by a zero crossing of the 
original speech signal which meets predetermined 
conditions, and a variable part, which lies between the 
left analysis edge and a right analysis edge that 
essentially coincides with the end of the current interval, 
the left and right analysis edges being associated, in the 
synthesized signal, respectively with a left synthesis edge 
and a right synthesis edge, of which the former coincides 
with the left analysis edge, with reference to a start-of- 
interval marker, and the latter coincides essentially with 
the end of the interval in the synthesized signal; 

- a first connecting function is applied on the 
part of waveform on the right of the left analysis edge of 
the current interval of the original signal, which function 
has a duration equal to that of a segment of synthesized 
waveform lying between the left and right synthesis- edges 
and an amplitude that progressively decreases and is 
maximum in correspondence with the left analysis edge; 

- a second connecting function is applied on the 
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part of waveform on the left of the subsequent interval of 
the original signal to be reproduced in synthesis, which 
function has a duration equal to that of a segment of 
synthesized waveform lying between the left and right 
synthesis edges and an amplitude that progressively 
increases and is maximum in correspondence with the 
beginning of said subsequent interval; 

- each interval of synthesized signal is built by 
reproducing unchanged the waveform in the unchanging part 
of the original interval and by joining thereto the 
waveform obtained by aligning in time and adding the two 
waveforms resulting from applying the two connecting 
functions . 

2. Method according to claim 1, characterized in that, 

if a duration of an interval is reduced or maintained 
unchanged for the synthesis with respect to the duration of 
the corresponding interval of the original signal, the left 
analysis edge and the left synthesis edge are determined 
with the following operations: 

- computing the number of zero crossings of the 
original signal waveform and assigning each zero crossing 
an index, increasing from the beginning towards the end of 
the interval; 

- checking that the number of .zero crossings is not 
lower than a first threshold; 

- searching, in case of positive outcome of the 
check, for a zero" crossing candidate to act as left 
analysis and synthesis edge; 

- backwards searching, among all zero crossings in 
the interval, except the last one, for a candidate that 
lies on the left of the right synthesis edge, is as close 
as possible to it and guarantees a time interval sufficient 
for the connecting functions to be applied, and assigning 
the task of left analysis and synthesis edge, to this 
candidate . 
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3. Method according to claim 2, characterized in that, 
in said computation of the number of zero crossings, zero 
crossings whose distance from the. previous one is lower 
than a predetermined distance are- not taken into 
consideration. 

4 . Method according to claim 2 or 3, characterized in 
that, upon a negative result of the backwards search and if 
the number of zero crossings is higher than the first 
threshold, the tasks of left analysis edge and left 
synthesis edge are assigned to the zero crossing whose 
index' corresponds to said threshold, ' if such a zero 
crossing lies on the left of the right synthesis edge. 

5. Method according to claim 2 or 3, characterized in 
that, upon a negative result of the backwards search and if 
the number of zero crossings is not higher than the first 
threshold, a further search phase is carried out to 
identify the zero crossings lying on the left of the right 
synthesis edge and having a distance from the latter that 
is not lower than a second threshold, and the tasks of left 
analysis edge and right analysis edge are assigned to the 
highest index zero crossing which meets these conditions. 

6. Method according to claim 2, characterized in that, 
if the comparison with the first threshold indicates that 
the number of zero crossings is lower than the first 
threshold, said backwards search is performed directly and, 
upon a negative result, said further search phase is 
performed directly. 

7. Method according to claim 1, characterized in that, 
if a duration of an interval is increased for the synthesis 
compared to the duration of a corresponding interval of the 
original signal, the left analysis edge and the right 
synthesis edge are determined with the following 
operations: 
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- computing the number of zero crossings of the 
original signal waveform; 

- comparing a duration lengthening of the synthesis 
interval and a duration of the original interval, to check 
that the lengthening does not exceed half the original 
interval duration ; 

- upon a positive result of the check, searching 
backwards, among all the zero crossings except the last 
one, for a candidate zero crossing that lies on the left of 
the right synthesis edge and is the first for which the 
distance from the right synthesis edge is not shorter than 
the lengthening of the interval duration, the tasks of left 
analysis edge and left synthesis edge being assigned to the 
candidate zero crossing. 

8. Method according to claim 7, characterized in that, 
in said computation of the number of zero crossings, the 
crossings whose distance from the previous crossing is 
lower than a predetermined distance * are not taken into 
consideration. 

9. Method according to claim 7 or 8, characterized in 
that, if an interval duration lengthening exceeds half the 
original interval duration or if the backwards search is 
unsuccessful, a further backwards search phase is. carried 
out to identify zero crossings lying on the left of the 
right synthesis edge and having a distance from the latter 
that is not lower than a third threshold; the distances 
from the right synthesis edge and from the right analysis 
edge and the ratio between these distances is computed for 
such zero crossings; said ratio is compared with the value 
of the ratio between the duration of the synthesis interval 
and the duration of the original interval, and the tasks of 
left analysis edge and left synthesis edge are assigned to 
the zero crossing whose index is the lowest among those for 
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which the ratio between the distances from the edges does 
not exceed by a predetermined factor the ratio between 

durations . 



RIDOUT Sl MAYBEE 
Toronto , Canada 
Patent Agents 
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